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We investigate numerically the time dependence of “window” overlaps in a three-dimensional 
Ising spin glass below its transition temperature after a rapid quench. Using an efficient GPU 
implementation, we are able to study large systems up to lateral length L = 128 and up to long 
times of t = 10 8 sweeps. We find that the data scales according to the ratio of the window size 
W to the non-equilibrium coherence length £(f). We also show a substantial change in behavior 
if the system is run for long enough that it globally equilibrates, i.e. £( t ) ~ L/ 2, where L is the 
lattice size. This indicates that the local behavior of a spin glass depends on the spin configurations 
(and presumably also the bonds) far away. We compare with similar simulations for the Ising 
ferromagnet. Based on these results, we speculate on a connection between the non-equilibrium 
dynamics discussed here and averages computed theoretically using the “metastate”. 
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I. INTRODUCTION 

Spin glasses EH3 below their transition temperature 
are not in equilibrium, except for very small sizes in some 
simulations. One therefore needs to be able to describe 
non-equilibrium behavior, and a lot of attention numer¬ 
ically has been focussed on the evolution of the 

system after a rapid quench to temperature T below the 
transition temperature T c . Locally, spins establish corre¬ 
lations so one anticipates that they will be correlated up 
to some distance, the coherence length £(f), which slowly 
increases with time. For distances longer than £( t ) cor¬ 
relations will decay exponentially, while at shorter dis¬ 
tances they will decay more slowly than that. Empiri¬ 
cally one finds that the growth of £(f) is compatible 
with a small power of t (although a logarithmic growth 
cannot be fully excluded using the available data), writ¬ 
ten as £(f) ~ t 1 / 2 (' z ”) where, z(T), a non-equilibrium dy¬ 
namic exponent is found to depend on the ratio T/T c . 

To understand the nature of the spin glass state one 
needs local probes, see e.g. [10] and references therein. 
A useful local probe is the distribution of the overlap q 
of the spins in two copies of the system in a window of 
linear size W. Equilibrium properties of window over¬ 
laps have been studied numerically before EH , but here 
we focus on their non-equilibrium behavior, which has 
not received much attention before apart from Ref. [gJ 
which studied the non-equilibrium evolution of a dimen¬ 
sionless ratio of cumulant averages evaluated in windows 
of different size. In this paper we study the time de¬ 
pendence of the window overlap distribution P\y(q), in a 
non-equilibrium situation. We find that the distribution 
scales as a function of the ratio of the window size W 
to £(t). The non-equilibrium window overlap distribu¬ 
tion is very different from the global equilibrium ove rlap 
distribution P(q) in the mean field theory of Parisi [12l — 
0- In particular Pw{ 0) depends quite strongly on W. 
However, if the system is run for a time long enough for 
the system to globally equilibrate, i.e. £(f) ~ L/ 2, then 


we find a change in the form of Pw(q), which happens 
rapidly when viewed on a logarithmic time scale, such 
that P(0) then has a rather a weak dependence on W 
and is quite similar to the q = 0 value of Parisi’s global 
equilibrium overlap distribution [T3] P(q)- The strong 
change in behavior when £(i) ~ L /2 indicates that lo¬ 
cal spin correlations are sensitive to spin orientations, 
and presumably also to the values of the interactions, at 
large (or at least intermediate) distances. 

The theoretical description of spin glasses below T c is 
complicated. One approach developed in recent years 
is known as the “metastate” [15; 17]. In this paper we 
also speculate on a possible connection between non- 
equilibrium correlations following a quench, and averages 
computed according to the metastate. 

The plan of this paper is as follows. In Sec. El we de¬ 
scribe the metastate and a possible connection between 
quantities calculated from it and non-equilibrium aver¬ 
ages following a quench. The model we simulate and 
the quantities we calculate are described in Sec. ED The 
results of the simulations are given in Sec. IIV1 together 
with corresponding results for a pure Ising ferromagnet, 
and our conclusions summarized in Sec. El 

II. AVERAGING IN SPIN GLASSES; THE 
METASTATE AND DYNAMICS 

In systems undergoing phase transitions it is desirable 
to know what are the various possible states to which the 
system can evolve below the transition temperature T c . 
A simple example is the Ising ferromagnet in zero mag¬ 
netic field for which there is just a pair of states below T c , 
related by flipping all the spins, the “up” and “down” spin 
states. If the system is in one of these states then “con¬ 
nected” correlation functions vanish at large distances, 
e.g. 

lim [(S i S j )-(S i )(S j )]= 0, (1) 

|Ri —Hj |—>-oo 
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which is known as “clustering” of the correlation func¬ 
tions. The angular brackets (• • •) denote a thermal aver¬ 
age, here restricted to one of these states to capture the 
symmetry breaking. By contrast if we simply perform 
the Boltzmann sum we give equal weight to both of these 
states, the symmetry is not broken so (Si) = ( Sj ) = 0, 
and hence the two terms in Eq. © do not cancel at 
large distances and the correlation functions do not have 
a clustering property. States which do not have a clus¬ 
tering property are called “mixed” states and those that 
do, like the “up” and “down” states of the ferromagnet, 
are called “pure” states. 

To keep the description of the system as simple as pos¬ 
sible it is desirable to use clustering (i.e. pure) states. In 
many cases this is easy because they are just the different 
states in which a global symmetry of the Hamiltonian is 
broken. However, in more complicated situations such as 
spin glasses, there can be pure states not related by any 
symmetry and so characterizing them can be quite diffi¬ 
cult. Nonetheless, it is argued EE EE EE EEiHl to be 
important to describe spin glasses in terms of pure states 
rather than by computing the Boltzmann sum. The lat¬ 
ter is done, for example, in the Parisi [TE - EE solution 
of the infinite-range Sherrington-Kirkpatrick (SK) [HJ 
model. 

To define pure states in general, consider the situation 
in Fig. [TJ The overall system is of very large size L and 
has free or periodic boundary conditions. We compute 
the thermal average exactly, and determine the correla¬ 
tion functions in a much smaller window of size W, some¬ 
where in the bulk of the system. These correlations may 
have the clustering property, in which case the window 
is in a pure state, or they may not in which case it is in 
a mixed state. In fact, since we consider only zero field, 
states come in symmetry-related pairs, so the simplest 
situation would be a single pair of pure states. 

But for a system like a spin glass, the correlations in 
the window could depend sensitively on the choice of in¬ 
teractions in distant regions of the of the system, perhaps 
even in a chaotic manner, an aspect first pointed out ex¬ 
plicitly by Newman and Stein (NS) [22J. To investigate 
this we divide the system of size L into an inner region of 
size M, larger than the window of size W which is in the 
middle of it, and an outer region between L and M. We 
then change the bonds in the outer region and recompute 
the correlation functions in the window. Eventually we 
let all sizes tend to infinity with L M W 1. 
It is possible that the state of the window is always the 
same as one changes the bonds in the outer region. How¬ 
ever, it is also possible that the state changes, perhaps 
chaotically, as one changes the bonds in the outer region. 
Several possible situations have been discussed in detail: 

• For each set of bonds in the outer region one has 
only a single pair of pure states, and one finds the 
same pair for every set of outer bonds. This is 
called the “droplet model” the theory for which has 
been developed in the greatest detail by Fisher and 
Huse 



FIG. 1. The length scales that are needed to discuss the 
Aizenman-Wehr (AW) metastate. The overall size of the sys¬ 
tem is L, which is assumed to be very large and has periodic 
or free boundary conditions. We consider an outer region, of 
size between M and L, shown shaded, where we average over 
different bond configurations, and an inner region, unshaded, 
where we consider just a single set of bonds. Spin correla¬ 
tions will be studied in a window of size W, less than M. In 
the metastate, we require that the different length all ulti¬ 
mately tend to infinity such that L>M>lf >1. In our 
simulations, the length scales are, of course, finite (actually 
quite small) but we shall still view the situation in the simu¬ 
lations as analogous to the theoretical discussion, in which, as 
for the metastate, L is the size of the system (with periodic 
boundary conditions) and IT is a small region where we mea¬ 
sure correlations, but now M, the intermediate scale, is the 
non-equilibrium coherence length £(i), the scale to which cor¬ 
relations have developed after a quench at time t = 0. In the 
simulations we can run for long enough, and take sufficiently 
small window sizes, to get data in the region where £(t) > W 
as shown. 


• For each set of bonds in the outer region one has 
only a single pair of pure states, but this pair varies 
chaotically as one changes the outer bonds. This is 
the “chaotic pairs” picture of NS (22]. 

• For each set of bonds in the outer region one has a 
mixed state, and this mixes changes in a chaotic 
way as the outer bonds are changed. This is 
called the “replica symmetry breaking” (RSB) pic- 
turcQ since it is the generalization to finite-range 


1 NS [© 0 call this the “non-standard” RSB picture, because 
they showed that a different, “standard”, RSB picture is not 
viable. As also emphasized recently by Read [23j| . the “non¬ 
standard” picture is the only viable RSB picture, so we shall 
omit the term “non-standard” and just refer to this scenario 
as the “RSB picture”. In fact, Read also shows that the RSB 
calculations lead directly to the “non-standard” picture. 
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models of Parisi’s fl^4I3| solution of the infinite- 
range SK model. The name arises because Parisi’s 
original solution used the replica method to average 
over the disorder. 

In order to describe the states of a spin glass one needs 
to give a statistical description of the different states the 
window can be in as the bonds in the outer region are 
varied. NS [H, [l6j] call this the metastate. The descrip¬ 
tion that we give here is actually a little different from 
that of NS and is due to Aizenman and Welir (AW) [la¬ 
in NS’s approach there is no intermediate scale M and 
one looks at the correlations in the window as the sys¬ 
tem size L is grown leaving the bonds already present 
unchanged. It is expected [25[ that the two forms of the 
metastate are equivalent. In agreement with Read [23} 
we find that it is easier to discuss the AW metastate. 

The AW metastate average is therefore performed by 
first doing a thermal average for the whole system, de¬ 
noted by (•••), followed by an average over the bonds in 
the outer region, denoted by [■ ■ • ] out . Following Read [23} 
we call this the metastate-averaged state (MAS). Hence, 
if i and j lie within the window, the spin glass correlation 
function of their spins in the MAS is given by 

a j = [(s l s J )] 2 out , ( 2 ) 


is expected that Cij tends to zero, presumably as 
a power law, which is commonly written as 


for Rij —> oo, which defines the exponent 

• In the RSB picture, which also has many states, 
MAS averaged correlations are similarly expected 
to decay as the power law in Eq. 0). In fact ( 
has been calculated in mean field theory m, H3- 
(corresponding to d > 6) assuming RSB, with 
the result ( = 4. 

A large spin glass system is not in thermal equilibrium 
below T c . Results from the Boltzmann sum do not, there¬ 
fore, correspond to experimental observations which are 
inevitably in a non-equilibrium situation. Are MAS av¬ 
erages any better in this regard? It is tempting to think 
so for the following reason. 

Imagine quenching the spin glass to below T c and ob¬ 
serving correlations in a local window of size W. Cor¬ 
relations will develop up to some coherence length £(f) 
which grows slowly with time. How does one expect the 
non-equilibrium correlation function 


(note the location of the square). After this average is 
done one can also average over the bonds in the inner 
region, which we denote by [* ' ' ]in* We will present data 
for the window overlap distribution for which averaging 
over the bonds in the inner region is, strictly, speaking, 
unnecessary since translation invariant MAS averages are 
self-averaging pj| [H, HI] • However, in practice, this last 
average is done in simulations to improve statistics. 

It is interesting to ask how the MAS average Cij varies 
at large distance Rij (= |Rj — Rj|) according to the three 
scenarios mentioned above: 


• In the droplet picture one finds always the same 
pair of thermodynamic states so presumably 

lim Cij = q 2 , (3) 

Rij—too 


where q = (Si) 2 is the Edwards-Anderson order- 
parameter, which is well defined if we add a small 
symmetry-breaking field to remove the degeneracy 
between the pair of pure states. Equation 0 then 
follows because of clustering of correlations in a sin¬ 
gle pure state, see Eq. 0. We should mention, 
though, that the approach to the constant value of 
q 2 is expected to be quite slow, a power-law rather 
than an exponential, and so, for the values of Rij 
that one can simulate, one may be far from the con¬ 
stant value (David Huse, private communication). 


• In the chaotic pairs picture, correlations in the win¬ 
dow alter, in sign as well as magnitude, as the outer 
bonds are varied. Hence, according to Read [23j], it 


c t (i,j) = [(s t m(t)) 2 }, ( 5 ) 

where [• • • ] denotes an average over all the bonds, to vary 
as a function of R,ij ? Let us assume that time is large 
enough that £(f) > W. We postulate that thermal fluc¬ 
tuations of the spins outside the window at a distance 
£(i) and greater, which are not equilibrated with respect 
to spins in the window, effectively generate a random 
noise to the spins in the window which plays a similar 
role to the random perturbation coming from changing 
the bonds in the outer region according to the AW metas¬ 
tate, see Fig. [I] Thus we suggest that £(f) is analogous 
to the intermediate scale M, separating inside and out¬ 
side regions, in the construction of the metastate. This is 
indicated in Fig [1] After this work was submitted it was 
brought to our attention that a similar picture of non- 
equilibrium dynamics following a quench was discussed 
earlier by White and Fisher (30(. They denote the state 
obtained after a quench as the “maturation metastate” 
and the distribution of states in the AW or NS picture 
as the “equilibrium metastate”. Here we speculate that 
these might be the same. We thank Nick Read for bring¬ 
ing this paper to our attention. 

This analogy suggests that the decay of correlations 
determined from the metastate may be the same as the 
decay of correlations following a quench, on scales shorter 
than the coherence length. We note that NS have also 
discussed dynamics following a quench [§ 11 , [§2j from a 
rigorous point of view. 

There have been many simulations which investi¬ 
gate the time dependence of correlations following a 
quench M- Interestingly these papers do see a power 
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L 

A 

Spin glass 

samp 

Ferromagnet 

128 

192 

64 

64 

- 

512 

32 

- 

512 

20 

512 

- 

16 

768 

2048 

12 

1024 

- 


TABLE I. The number of samples studied for different system 
sizes. 

law decay of the correlation function in Eq. © for suffi¬ 
ciently long times that £(t) > R,j , i.e. 

oc -T for R i:j < £(t) < L . (6) 

The exponent a is found to be about 1/2 in three di¬ 
mensions 0 - 1 . Equation d6j) is of the same form as 
Eq. (j4j) which is obtained from metastate calculations for 
the Edwards-Anderson model [23|, [29j in the mean field 
approximation, assuming the RSB picture. The droplet 
theory predicts a different result, namely Eq. ©, though, 
of course, the numerical data may not be at large enough 
length scales to be in the asymptotic scaling regime. 

III. THE MODEL AND QUANTITIES TO BE 
CALCULATED 



FIG. 2. (Color online) A representative set of results for the 
window overlap distribution, for window size W = 4 for lattice 
size L = 128 at T = 0.8. Data is shown for times t = 10 fc , 
where k = 1, 2, • • • ,8. 


We also compute the time-dependent window overlap 
distribution defined by 

Pw{q) = [{5 (q-q 12 ))] , (8) 


We simulate the Edwards-Anderson [33] Ising spin 
glass model with Hamiltonian 


where q 1 ’ 2 , the window overlap between replicas “(1)” 
and “(2)”, is 


H = -Y,JnSiS j , (7) 

(*b) 

where the spins Si take values ±1 and are on the sites of 
a simple cubic lattice with N = L 3 spins with periodic 
boundary conditions. The quenched interactions J tj are 
between nearest neighbors and take values ±1 with equal 
probability. The latest determination of the transition 
temperature of this model is T c = 1.102(3) [34]. Here we 
work at a fixed temperature of T = 0.8 ~ 0.73T C . Most 
of the simulations are for system size L = 128, which 
can not be brought to equilibrium in available computer 
time, but we also perform some simulations at smaller 
sizes to investigate the change in behavior when the sys¬ 
tem reaches global equilibrium. The number of samples 
simulated for each size is shown in Table [1] 

We run two copies of the system with the same bonds 
but different initial random spin configurations, which we 
quench to T = 0.8 at time t = 0, and then let the system 
evolve. To perform long runs on large lattices we have im¬ 
plemented an efficient Monte Carlo code on GPUs, see |9| 
for details. At a logarithmically increasing set of times 
we store the spin configurations from which we calculate 
the correlation function in Eq. © as a function of Rij at 
different times. 


1 


r 


1,2 _L_ V- c(l) c(2) 

q \yd 

2=1 


(9) 


in which the sum is over the sites in the window and, for 
ease of notation, we have suppressed an index t on Pw(q) 
which would indicate that it also depends on time. To im¬ 
prove statistics we average over all non-overlapping win¬ 
dows of size W. The number of these is [L/IV \ d where 
[• • • J indicates rounding down to the nearest integer. In 
addition, we smooth the data by computing, for each dis¬ 
crete value of the overlap, q o say, an average of the distri¬ 
bution on neighboring q- values weighted by a normalized 
kernel which falls to zero as |g — 9o| increases [35| . 


IV. RESULTS 
A. Spin Glass 

An example of our data for the window overlap dis¬ 
tribution is shown in Fig. [2] for W = 4. One sees an 
evolution from a single peak structure at short times, 
presumably Gaussian, to a two-peaked structure at long 
times. For larger window sizes, the distribution evolves 
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FIG. 3. (Color online) Results for the weight in the window 
overlap distribution at q = 0 for different window sizes as a 
function of time. The lattice size is L = 128 and T = 0.8. 



FIG. 4. (Color online) The main figure shows a scaling plot of 
Pw{0)/W a/2 against £/W, in which we used the results for 
£(t) shown in the inset, which are obtained in Ref. Q, and 
took the value a = 0.438 also from Ref. Q. The data collapse 
is excellent. The data is for system size L = 128 and T = 0.8. 


more slowly, as shown in the data for Pw( 0), the weight 
of the distribution at q = 0, for different sizes in Fig. [3] 

We would like to perform a scaling collapse of the data 
in Fig. [3] to ascertain the dependence of Pw{ 0) on t and 
W. However, rather than scaling with respect to t we find 
it better to scale with the dynamic coherence length £(t). 
At long times, where £(t) Rij , the time-dependent cor¬ 
relation function in Eq. m varies with an inverse power 
of Rij as shown in Eq. ©, so a natural scaling ansatz is 




mJ 


( 10 ) 


The coherence length £(t) can be taken from a ratio of 
moments of 0, e.g. 


= fp /2 r2 C t {r) dr 
fo /2 r c t{r)dr 


( 11 ) 


sites i and j in the window since 

hj 

= ^aE[(W>(sW)] 

= (12) 

hj 

Using Eq. m this can be written as 

K<?2)] = i bj RR , dRdR '\ R - R '^ 9 - R, w 



= W" a /(y), (13) 


In practice the integral is performed along x, y and z 
axes. The data for £(t) obtained in this way in Ref. Q 
is shown in the inset to Fig. 0] 

Note that this calculation of £ (t) did not make any ref¬ 
erence to a window. However, if we compute the second 
moment of the window overlap distribution, [(<Z 2 )], we 
note first that it is just the average of Ct(i,j) over all 


where we used the substitution x = r/W in the next to 
last line. 

If we divide q by an arbitrary scale factor A the dis¬ 
tribution of q' (= q/X) is P(q') where P(q) = X~ 1 P(q/X) 
because both distributions are normalized. If we take A = 
a, the standard deviation of P(q), then P(0) = cr _1 P(0). 
But P(q') has standard deviation unity, and so, if the 
distribution is smooth and extends down to the origin, 
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FIG. 5. (Color online) Data for Pw{ 0) for different values 
of W for size L = 16. At time in the range 10 7 -10 9 this 
rather small system fully equilibrates leading to a decrease in 
the data which is quite rapid on this log scale. The dashed 
line shows the equilibrium value of the bulk order parameter 
distribution for L = 16, i.e. W = L = 16. One sees that the 
equilibrium values of Pw{0) for W < L are very similar to 
that of the bulk overlap. 



FIG. 6. (Color online) Data for Pi(0) for different system sizes 
at T = 0.8. For the three smaller sizes, L = 12,16 and 20 the 
system equilibrates, leading to a pronounced drop in the data, 
at a time which increases with L. The inset plots the same 
data against £/L where for £ we use a fit to the data in the 
inset of Fig. 2] The collapse of the data in the region where 
it decreases, which is quite rapid on this log scale, shows that 
the decrease occurs when £ is a fixed fraction (about 1/2) of 
the system size, indicating full equilibration. 


we have P(0) ~ 1 and hence P( 0) ~ a 1 . Consequently, 
from Eq. m, the expected scaling of Pw( 0) is 

P w (Q) = W a / 2 F^j . (14) 

For t large but still smaller than the time to equilibrate 
the whole system, the dependence on £ must drop out 
and so 

P w ( 0) oc W a/ 2 for W « £(£) < L . (15) 

For short times where £(t) <C W the spins in the window 
are random, so the mean square window overlap goes 
like 1 /W d (in d dimensions) and consequently Pw( 0) oc 
W d / 2 _ Presumably we then have F(x) oc £ _ ( d_a )/ 2 for 
x —> 0. This actually gives Pw{ 0) oc FF d / 2 /£( d_a )/ 2 but 
when £(f) < 1 corrections to scaling occur which cause 
£ to be replaced by a cutoff of order unity and so one 
obtains the desired result. 

We take £(t) from Ref. [9|, evaluated according to 
Eq. (flTTl . and also use the value of a from Ref. [(|, 
a = 0.438(11). This exponent has also been computed 
in Ref. [8] with a very similar value, a = 0.442(11). The 
result of scaling the data in Fig. [3] according to Eq. (fl4l) 
is shown in the main part of Fig. [I] Clearly the scaling 
collapse works very well. 

The power law decay of correlation in Eq. ©, and the 
resulting behavior of the window order parameter distri¬ 
bution in Eq. are for a non-equilibrium situation 

where £(t) <C L. However, we shall now see that a dra¬ 
matic change occurs at sufficiently long times that global 
equilibrium occurs, i.e. when £(£) ~ L/ 2. In this re¬ 
gion, we will find that the correlation function no longer 
decays to zero because there is spin glass order in equi¬ 
librium, and the weight of the window distribution at 
q = 0 [ill, EH becomes roughly independent of window 
size rather than increasing with window size in the man¬ 
ner shown in Eq. m- 

We demonstrate this change in behavior for the win¬ 
dow overlaps explicitly as a function of time in Figs. [5] 
and El Since equilibrating size L = 128 is completely 
infeasible we show data for smaller sizes which we can 
bring to global equilibrium. Figure [5] shows results for 
L = 16 with window sizes W = 4,6 and 8. A rapid de¬ 
crease is seen for t in the region 10' 10 9 to a value which 
is independent of window size. As will be confirmed in 
Fig.ua the data after the drop represents global equilib¬ 
rium. The dashed line in Fig. [5] is the bulk value of the 
equilibrium overlap distribution at q = 0 and we see that 
this value is very similar to that of equilibrium window 
overlaps, as was also found earlier [llL |29|. 

To confirm that this change in behavior occurs when 
£ ~ L/2 we plot results for -FV(O) for a fixed window 
size but different system sizes in Fig. O For short times 
the data is independent of L indicating that (<L, but 
at later times a more rapid decrease occurs at a time 
which increases with L. The inset shows the data plot¬ 
ted against £/L clearly demonstrating that the region 
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FIG. 7. (Color online) Data for Pe( 0) for different system 
sizes at T = 3.6 ~ 0.8077 for the ferromagnet. The plateau 
at intermediate times becomes longer for larger L. The ex¬ 
planation is that a fraction of the runs gets stuck in a state 
with two big domains for a long time, thus contributing a 
certain number of overlaps with q ~ 0. The inset shows the 
probability that two large domains coexist. 


FIG. 8. (Color online) Plot of Pw( 0) multiplied by the ratio 
of the system size L to the window size W for different values 
of W and L at T = 3.6 ~ 0.8077 for the ferromagnet. On this 
plot the height of the plateau at intermediate times seems 
to be independent of L and W showing that Pw{ 0) itself is 
proportional to W/L, which we interpret as the probability 
that a straight domain wall goes through the window. The 
dashed horizontal line is a guide to the eye. 







with rapid decrease occurs when £/L is about 1/2. This 
confirms that the decrease is associated with complete 
equilibration of the system. 

B. Ferromagnet 

For comparison we also did simulations of the ferro¬ 
magnet, p = 1.0, at temperature T = 3.6. Since T c ~ 
4.51 for the ferromagnet, this corresponds to T = 0.80T C , 
a similar fraction of T c as used in the spin glass simula¬ 
tions. The number of samples is detailed in Table in it 
should be pointed out that we are still using a single 
random number for multiple samples (due to multi-spin 
coding techniques) but with different initial configura¬ 
tions, as is common practice for spin-glass simulations. 
But in ferromagnetic equilibrium this causes the samples 
to become almost completely correlated. However, before 
equilibration, due to the different initial configurations, 
the dynamics of the different samples is different. 

Data for the window overlap for window size W = 6 
and different lattice sizes are shown in Fig. [3 Even our 
largest systems can be equilibrated, as indicated by the 
data dropping to to a very small value (< 10 -3 ) at the 
longest times. Note that the value of Pw( 0) is not exactly 
zero even when the system has fully equilibrated because 
of rare thermal fluctuations. At short times the decay is 


roughly 7 -1 / 2 as expected from coarsening [36!], according 
to which £(t), the typical domain size, grows proportional 
to t 1 / 2 . However, in addition, a plateau appears at in¬ 
termediate times. We shall see that this plateau occurs 
because in some runs, even when the correlation length 
has grown to the size of the system, a single domain with 
straight walls persists for a much longer time. Evidence 
for this is shown in the inset to Fig. [3 which plots the 
probability of finding two large clusters of oppositely ori¬ 
ented spins. This quantity has plateaus for the same 
range of time as the data for 0) shown in the main 
part of the figure. 

Figure [5] plots data for different system sizes and win¬ 
dow sizes, and shows that the height of the plateau is 
proportional to W/L which has a straightforward inter¬ 
pretation as the probability that a straight domain wall 
passes through the window. 

We find that the time at the beginning of the plateau 
varies as L 2 , which is expected since it is the time for the 
coherence length to grow to the system size according to 
the coarsening picture in which £( t ) oc i 1 / 2 . The time 
at the end of the plateau grows more rapidly and we 
find empirically it is roughly proportional to L 4 ' 8 . We 
presume that this is the time scale needed for a random 
walk of the (straight) domain walls to cause the domains 
to meet and form one big domain. S. Redner (private 
communication) has argued that this exponent is exactly 
four, and our data is consistent with this value. 

The rich dynamics of three-dimensional Ising ferro- 










































magnets after a quench have been studied in great de¬ 
tail, see e.g. [37], at very low and zero temperature. By 
contrast, our results are for a much higher temperature, 
though still below T c . Based on the preliminary findings 
presented here, we feel it would be interesting to study 
this region in more detail in the future. 

V. CONCLUSIONS 

We have shown that the non-equilibrium window over¬ 
lap distribution of a spin glass following a quench to be¬ 
low T c can be well characterized by the ratio of the dy¬ 
namic coherence length £(f) to the window size W. For 
a fixed W the distribution tends to a well defined limit 
at long times such that £(f) W but where £(t) is still 
much less than the system size L. This distribution de¬ 
pends strongly on W; for example P w ( 0) oc W a / 1 2 3 4 5 6 7 8 9 where 
a — 0.44. 

However, if we can run the simulation for suffi¬ 
ciently long times that the system globally equilibrates, 
i.e. £(t) — L/ 2, then there is a change in behavior, which 
is abrupt when plotted on a logarithmic time scale, see 
Fig. [6] such that Pw{ 0) then only depends weakly on W 
and is very similar to the value at zero overlap of Parisi’s 
global overlap distribution P{q). Though a similar look¬ 
ing plateau was found for the not-quite fully equilibrated 
ferromagnet, characterized by the existence of domain 
walls, it was qualitatively different since the height of 
the plateau depends on the overall system size L for the 
ferromagnet. By contrast, for the spin glass, the data 
in Fig. [Gl while admittedly not fully in the plateau re¬ 


gion, does not show any dependence on L until the final 
equilibrium is reached (the end of the plateau). 

The strong change in behavior for the spin glass when 
£(f) ~ Lj 2 indicates that local spin correlations are sen¬ 
sitive to spin orientations, and presumably also to the 
values of the interactions, at large distances. According 
to the droplet theory, the local state of the system does 
not depend on the values of the interactions sufficiently 
far away. If the droplet theory is correct asymptotically, 
the length-scale beyond which this independence occurs 
must be much larger than the system sizes we have been 
able to equilibrate below T c (namely L = 16). 

In addition, we have speculated on a possible con¬ 
nection between the non-equilibrium dynamics discussed 
here and averages computed theoretically using the 
“metastate”. For a future better understanding of this 
possible connection via numerical simulations a more in¬ 
tense use of powerful yet rather cheap devices as GPUs, 
like in the present work [§j, or the application of new al¬ 
gorithms like population annealing to spin glasses [H, [Hj 
might be useful. 
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